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Abstract 

In this paper we consider the problem of global asymptotic stabi¬ 
lization with prescribed local behavior. We show that this problem 
can be formulated in terms of control Lyapunov functions. Moreover, 
we show that if the local control law has been synthesized employing 
a LQ approach, then the associated Lyapunov function can be seen 
as the value function of an optimal problem with some specihc local 
properties. We illustrate these results on two specihc classes of sys¬ 
tems: backstepping and feedforward systems. Finally, we show how 
this framework can be employed when considering the orbital transfer 
problem. 


1 Introduction 

The synthesis of a stabilizing control law for systems described by nonlinear 
differential equations has been the subject of great interest by the nonlinear 
control community during the last three decades. Depending on the structure 
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of the model, some techniques are now available to synthesize control laws 
ensuring global and asymptotic stabilization of the equilibrium point. 

For instance, we can refer to the popular backstopping approach (see 
[mil] and the reference therein), or the forwarding approach (see p!^[8(fT5]l 
and some others based on energy considerations or dissipativity properties 
(see for a survey of the available approaches). 

Although the global asymptotic stability of the steady point can be 
achieved in some specihc cases, it remains difficult to address in the same 
control objective performance issues of a nonlinear system in a closed loop. 
However, when the hrst order approximation of the non-linear model is con¬ 
sidered, some performance aspects can be addressed by using linear optimal 
control techniques (using LQ controller for instance). 

Hence, it is interesting to raise the question of synthesizing a nonlinear 
control law which guarantees the global asymptotic stability of the origin 
while ensuring a prescribed local linear behavior. This problem has been 
addressed in |^. In this paper local optimal control laws are designed for 
systems which admits the existence of a backstopping. 

In the present paper we consider this problem in a general manner. In a 
hrst section we will motivate this control problem and we will consider a hrst 
strategy based on the design of a uniting control Lyapunov function. We 
will show that this is related to an equivalent problem which is the design 
of a control Lyapunov function with a specihc property on the quadratic 
approximation around the origin. In a second part of this paper, we will 
consider the case in which the prescribed local behavior is an optimal LQ 
controller. In this framework, we investigate what type of performances is 
achieved by the control solution to the stabilization with prescribed local 
behavior. In a third part we consider two specihc classes of systems and 
show how the control with prescribed local behavior can be solved. With 
our new context we revisit partially results obtained in [7]. Finally in the 
fourth part of the paper, we consider a specihc control problem which is the 
orbital transfer problem. Employing the Lyapunov approach of Kellet and 
Praly in [S] we will exhibit a class of costs for which the stabilization with 
local optimality can be achieved. 


2 


2 Stabilization with prescribed local behav¬ 
ior 

To present the problem under consideration, we introduce a general con¬ 
trolled nonlinear system described by the following ordinary differential equa¬ 
tion: 


T = u) , 


( 1 ) 


with the state a: in M" and <h : M” x —)■ R” is a (7^ function such that 
<h(0, 0) = 0 and u in R^ is a control input. For this system, we can introduce 
the two matrices A in R”^"' and B in R"’^^ describing its hrst order approx¬ 
imation : A := If (0,0) , B := |f(0,0) . All along the paper hidden in our 
assumptions, the couple (A, B) is assumed to be stabilizable. 

For system ([T]), the problem we intend to solve can be described as follows: 

Global asymptotic stabilization with prescribed local behavior: Let 

a linear state feedback law u = KqX with Kq in R^^” which stabilizes the 
hrst order approximation of system ([1]) (i.e. A -|- BiFo is Hurwitz) be given. 
We are looking for a stabilizing control law u = ao(x), with Oq : R” ^ R^, a 
locally Lipschitz map differentiable at 0 such that: 

1. The origin of the closed-loop system k = ^{x,ao{x)) is globally and 
asymptotically stable ; 

2. The hrst order approximation of the control law cCq satishes the follow¬ 
ing equality. 



( 2 ) 


This problem has already been addressed in the literature. For instance, 
it is the topic of the papers [3 [1311]. Note moreover that this subject can 
be related to the problem of uniting a local and a global control laws as 
introduced in [20] (see also [T6]). 

In this paper, we restrict our attention to the particular case in which the 
system is input affine. More precisely we consider systems in the form 


T = a{x) + b{x)u , 


(3) 


with the two functions a : R" —)■ R"' and 6 : R" —)■ In this case we 

get A = If (0) and B = 6(0). 
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Employing the tools developed in |2] it is possible to show that merg¬ 
ing control Lyapunov function may solve the problem of stabilization with 
prescribed local behavior. In the following, we show that working with the 
control Lyapunov function is indeed equivalent to address this problem. 

Theorem 1. Given a linear state feedback law u = KgX with in 
which stabilizes the first order approximation of system The following 
two statements are equivalent. 

1. There exists a locally Lipschitz function Oo : M” —)■ solution to the 

global asymptotic stabilization with prescribed local behavior problem. 

2. There exists a proper, positive definite function 1/ : M" —)■ M+ such 
that the following two properties are satisfied. 

• If we denot^ P := ^H(V){0), then P is a positive definite matrix. 
Moreover this inequality holds. 

(A + MKo)'P + P(A + MKo) < 0 ; (4) 

• Artstein condition is satisfied. More precisely, this implication 
holds for all ar m M" \ {0}, 

LbV(x) = 0^ LaV(x) < 0, (5) 

where LhV{-) = dV/dx ■ b{-), and LaV is analogously defined. 

Proof : 1) ^ 2) The proof of this part of the theorem is based on recent 
results obtained in [2]. Indeed, the design of the function V is obtained 
from the uniting of a quadratic local control Lyapunov function (denoted Vq) 
and a global control Lyapunov function (denoted lAo) obtained employing a 
converse Lyapunov theorem. 

First of all, employing the converse Lyapunov theorem of Kurzweil in 
[T2] . there exists a C°° function 14o : K" —^ 1^+ such that ^^{x)[a{x) + 
b{x)ao{x)] < 0 , y X jtz 0 , On the other hand, A -|- MKg being Hurwitz, 
there exists a matrix P such that the algebraic Lyapunov inequality (jl]) 

^In the following, given a function V : M" —>■ M, the notation H{V){x) is the 
Hessian matrix in evaluated at x of the function V. More precisely, it is the matrix 

iHiV)kA^) = ^ix). 
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is satisfied. Let Vq be the quadratic function Vo{x) = x'Px. Due to the 
fact that Ko satishes equation ([2]) it yields that the matrix A + BiLo is the 
hrst order approximation of the system (|3]) with the control law u = ao{x). 
Consequently, it implies that there exists a positive real number ei such that 
^(x)[a{x) + b{x)ao{x)] < 0 , V 0 < |ar| < ei . This implies that the time 
derivative of the two control Lyapunov functions Vq and 14o can be made 
negative dehnite with the same control law in a neighborhood of the origin. 
Employing [21 Theorem 2.1], it yields the existence of a function V : M” —>■ M+ 
which is at the origin and a positive real number 62 such that the following 
two properties hold. 

• For all A' in M"- \ {0}, ^{x)[a{x) + b{x)ao{x)] < 0 . Hence, Equation 
([5]) is satished ; 

• For all in M"' such that Ia’I < € 2 , we have V{x) = Vo{x) . Consequently 
niV){0) = 2P. 

2) ^ 1) Let Q be the positive dehnite matrix dehned as, Q := — (A + 
BiLo)'P + P(A + BiCo) • Employing the local approximation of the Lyapunov 
function V, it is possible to hnd vq such that 

LaV(x) + LbV{x)KoX < 0 , Va^ e {0 < V{x) < ro} . 


This implies that the control Lyapunov function V satishes the small control 
property (see PD- Hence, we get the existence of a control law cToo (given 
by Sontag’s universal formulae introduced in [19]) such that this one satishes 
for all AT ^ 0 

LaV{x) + LbV{x)aoo{x) < 0 . 


A solution to the stabilization with prescribed local problem can be given by 
the control law ao{x) = p{V{x))a^{x) + (1 — p{V{x)))KoX where p : M+ —)■ 

r 0 s < ^ 

[0,1] is any locally Lipschitz function such that p{s) = < ^ Note 


that with this selection, it yields that equality ([2]) holds. Moreover, we have 
along the solution of the system (j3|) 


V{x) 


u=ao{x) 


= p(V(x)) V(x) 


U=Qoo 


{l-p{V{x)))V{x) 


< 0 


u=K„x 


Hence, we get the result. 


□ 
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From this theorem, we see that looking for a global control Lyapunov 
function locally assigned by the prescribed local behavior and looking for the 
controller itself are equivalent problems. 

3 Locally optimal and globally inverse opti¬ 
mal control laws 

If one wants to guarantee a specific behavior on the closed loop system, one 
might want to find a control law which minimizes a specific cost function. 
More precisely, we may look for a stabilizing control law which minimizes 
the criterium 

r+oo 

J{x]u) = / q{X{x,t]u)) + u{tyr{X{x,t]u))u{t)dt, (6) 

Jo 

where X{x,t-,u) is the solution of the system (j3]) initiated from Xq = x at 
t = 0 and employing the control u : M+ —?■ q : M” —?■ M+ is a continuous 

function and r is a continuous function which values r{x) are symmetric 
positive dehnite matrices. 

The control law which solves this minimization problem (see [18]) is given 
as a state feedback 

u= ~r{x)-^LbV{x)', (7) 

where V : M"' —)■ M+ is the solution with 1/(0) = 0 to the following Hamilton- 
Jacobi-Bellman equation for all a’ in M” 

q{x) + LaV{x) - ^Lfol/ {x)r{x)~^LbV{x)' = 0 . (8) 

Given a function q and a function r, it is in general difficult or impossible 
to solve the so called HJB equation. However, for linear system, this might 
be solved easily. If we consider the first order approximation of the system 
([2D, and given a positive definite matrix R and a positive semi definite matrix 
Q we can introduce the quadratic cost: 

r+oo 

J{x-,u) = / [X{x,t-,u)'QX{x,t-,u) + u{tyRu{t)]dt, (9) 

Jo 

In this context, solving the HJB equation can be rephrased in solving the 
algebraic Riccati equation given as 

PA + A'P-PMR-^M’P + Q = 0. (10) 
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It is well known that provided, the couple (A, B) is controllable, it is 
possible to hnd a solution to this equation. Hence, for the hrst order approx¬ 
imation, it is possible to solve the optimal control problem when considering 
a cost in the form of fl9l) . 

From this discussion, we see that an interesting control strategy is to 
solve the stabilization with prescribed local behavior with the local behavior 
obtained solving LQ control strategy. Note however that once we have solved 
this problem, one may wonder what type of performances has been achieved 
by this new control law. The following Theorem addresses this point and is 
inspired from [18] (see also [H])- Following Theorem [H this one is given in 
terms of control Lyapunov functions. 

Theorem 2 (Local optimality and global inverse optimality). Given two 
positive definite matrices R and Q. Assume there exists a proper positive 
definite function V : M” —?■ M+ such that the following two properties hold. 

• The matrix P := H(y){0) is positive definite matrix and satisfies the 
following eguality. 


PA + A'P - FBi?-^B'P + Q = 0 ; (11) 

• Eguation ([5|) is satisfied. 

Then there exist g : M” —)■ M+ a continuous function, at zero and r a con¬ 
tinuous function whose values r{x) are symmetric positive definite matrices 
such that the following properties are satisfied. 

• The function q and r satisfy 

P(g)(0) = 2g, r(0) = P; (12) 

• The function V is a value function associated to the cost More 
precisely, V satisfies the HJB equation 

Proof : This proof is inspired from some of the results of |14j . 

First of all, there exists a positive real number ro such that for all a’ such 
that 0 < V{x) < To we have —LfV{x) jLgV{x)R~^LgV{xy > 0 . Now, 
for all k in N, we consider Ck the subset of M"" dehned as Ck = kr^ < 
V{x) < {k l)ro} . Note that since the function V is proper, for all k the 
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set Ck is a compact subset. Assume for the time being that for all k there 
exists ik in M_|_ such that : 

LaV{x) - jUV{x)R-^LgV{xy <0,yxeCk. (13) 

Let fi be any continuous function such that, 

r = 1 , s < f, 

/i(s) < > 1 , f<s<ro, 

[ > 4 , kro< s <{k + l)ro . 

Moreover, let r(x) := , and q{x) := -LaV{x) + \Liy {x)r{x)-^Liy {x)'. 

With flT^ and the dehnition of p, it yields, q{x) > 0 , Vat 7 ^ 0 . Hence, V 
is solution to the associated HJB equation. Note moreover that we have 
r(0) = R and ^ff(q)(0) = A'P + PA — PMR~^M'P = Q . Hence, the result. 

In conclusion, to get the result, we only need to show that for all k in M, 
there exists £k such that ca is satished. Assume this is not the case for a 
specihc k in N. This implies that for all j in M there exists Xj in Ck such that 
LaV{xj) — jLbV{xj)R~^LfjV{xjY > 0 . The sequence Xj being in a compact 
set, we know there exists a converging subsequence denoted which 

converges toward a cluster point denoted a’* in Ck- The previous inequality 
can be rewritten as: > \LbV{xj^)R~^L^V(xj^)' > 0 . Letting goes 

to inhnity yields LaV{x*) > 0 and LbV{x*) = 0. With dS]), this implies that 
LaV{x*) < 0 hence a contradiction. This ends the proof. □ 

This Theorem establishes that if we solve the stabilization with a pre¬ 
scribed local behavior, we may design a control law u = ao(x) such that 
this one is solution to an optimal control problem and such that the local 
approximation of the associated cost is exactly the one of the local system. 
This framework has already been studied in the literature in [7]. In this pa¬ 
per is addressed the design of a backstopping with a prescribed local optimal 
control law. In our context we get a Lyapunov sufficient condition to design 
a globally and asymptotically stabilizing optimal control law with prescribed 
local cost function. 




4 Some sufficient conditions 


In this section we give some snfficient conditions allowing us to solve the 
stabilization with prescribed local behavior problem. The first result is ob¬ 
tained from the tools developed in [2]. It assumes the existence of a global 
control Lyapunov function and a sufficient condition is given in terms of a 
matrix inequality. In the second and third results we give some structural 
conditions on the vector field to avoid a matrix inequality. 

4.1 Based on matrix inequalities 

The first solution to solve the stabilization with prescribed local behavior is 
to follow the result of | 2 ] and to assume that there exists a global control 
Lyapunov function which can be modified locally in order to fit in the context 
of Theorem [1] 

Assumption 1. There exists a positive definite and function I4o : K"' —>■ 
M+ such that the following holds. 

1. The implication ^ is satisfied. 

2. The function I4o is locally quadratic, i.e. Poo = H{V){0) is a positive 
definite matrix. 

In this context the result obtained from [2] may be formalized as follows. 

Theorem 3. (J^) Let Assumption^ be satisfied. Let Ko in he a matrix 
such that A -I- MKo is Hurwitz with A and B defined in If there exists 


Ku in R^^"' and a positive definite matrix P in R"'^"' such that these matrix 

inequalities are satisfied 



(A + MKofiP + P(A + MKo) 

< 0, 


(A + MK^yP + P(A + MkJ) 

< 0, 

(14) 

(A -|- MKu)'Poo + Poo(-^ + BJL^j) 

< 0, 



then there exists a smooth function Oq : R"" —)■ R^ which solves the global 
asymptotic stabilization with prescribed local behavior. 

Proof : The proof of this result is a direct consequence of the tools developed 

in [ 2 ]. □ 
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In inequalities ffl^ . P and Ku are the unknown. This implies that this 
inequality is not linear. However by introducing some new variables, it is 
possible to give a (conservative) linear relaxation which allows the use of the 
tools devoted to solve linear matrix inequalities (see [3] for instance). 


4.2 Strict feedback form 

Following the work of [7], consider the case in which system (|3]) with state 
A’ = {y, x) can be written in the following form 

y = hiiy) + h 2 {y)x , X = f{y, x) + g{y, x)u . (15) 


with y in W^y, x in M and g{y, x) ^ 0 for all {y, x). 

In this case, the hrst order approximation of the system is 


A = 

■ Hi 

H2 ■ 

, IB = 

■ 0 ■ 

Fi 

F2 


G 


(16) 


with ill = »^( 0 ), ffs =/i 2 ( 0 ), 
For this class of system we 


F, = ^{0,0),F2 = %{0,0),G = g{0,0). 
make the following assumption. 


Assumption 2. For all couples {Ky^ Py) with Ky in and Py a positive 
definite matrix in such that Py{Hi + H 2 Ky) + {Hi + H 2 Ky)'Py < 0 , 

there exists a smooth function Vy : M+ such that 77(14) ( 0 ) ~ 

such that for all y Q 


Lh^Vyiy) = 0 ^ Lh,Vy{y) < 0 . (17) 

With Theorem [H this assumption establishes that the stabilization with 
prescribed local behavior is satished for the y subsystem seeing x as the 
control input. 

For this class of system, we have the following theorem which can already 
be found in [7] when restricted to locally optimal controllers. 

Theorem 4 (Backstepping Case). Let Assumption\^ he satisfied. Let Kg in 
he a matrix such that A + BAq is Hurwitz with A and B defined in m. 
Then there exists a smooth function cKq : M"' —)■ which solves the global 

asymptotic stabilization with prescribed local behavior. 
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Proof : Let P be a positive definite matrix such that the algebraic Lyapunov 

Ip P 

inequality dl]) is satisfied. This matrix can be rewritten P = „ 

L -^12 -^22 

with P 22 ,Pi 2 ,P 22 matrices respectively in M. Let T be the 

matrix in defined a^ T = 


. 12 
P22 


. Note that this matrix 


satisfies T'P = [ Py 0 ] , T'PB = 0 , where Py = Pu — P 12 P 22 P 12 
Schur complement of P. 

By pre and post multiplying inequality (jl]) respectively by T' and T it 
yields the following inequality. 


P J Pi - P 


P' 


12 


P 


22 


H, - ] P,<0 

^22 , 


(18) 


The matrix P being positive definite, its Schur complement Py is also positive 
definite. Hence, inequality flTSl) can be seen as a Lyapunov inequality and 
X = —^y as a stabilizing local controller for the y subsystem with Py 
as associated Lyapunov matrix. With Assumption |2l and Theorem [1] we 
know there exist a smooth function ay : —)■ M and a smooth function 

Vy : M+ such that the following two properties hold. 

• The origin of the system y = hi{y) + h 2 {y)ay{y) is globally and asymp¬ 
totically stable with associated Lyapunov function Vy. More precisely, 
we have 

dV 

[hi{y) + h 2 {y)ay{y)] < 0 , V?/ ^ 0 ; (19) 

• We have the local properties ^(0) = ~^ y P(P/)(0) = ‘^Py ■ 
Consider now the function 


V(x) = V,(y) + P 22 (x - a,(y)f . (20) 

Note that this function is proper and positive definite. Moreover, we have 
LbV(x) = 2P22(x—ay(y))g(x, y) . Moreover, since it is assumed that g{x, y) 7 ^ 
0, this implies LhV{x) = 0,x^0^x = ay{y) . Note that when x = ay{y), 
with flT^ we have for all ?/ 7 ^ 0 LaV{x) = ^{y)h{y,ay{y)) < 0 . Hence, 
Equation (j5]) is satisfied. Finally, we have the following equality. P(l/)(0) = 

^Given a positive integer n, the notation Id„ is the identity matrix in 
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2 P . Hence, with Theorems [T] we get the result. 


□ 


Note that with Theorem [2], this theorem establishes that given Q, a pos¬ 
itive dehnite matrix in and R, a positive real number, then there 

exist q, r and ao which is solution to an optimal control problem with cost 
J{x,u) dehned in dH]), with q and r which satisfy flT^ . In other words we 
can design a globally and asymptotically stabilizing optimal control law with 
prescribed local cost function as already seen in [7]. 

4.3 Feedforward form 

Following our previous work in |1], consider the case in which the system 
with state ar = [y, x) can be written in the form 

y = h(x) , X = f(x) + g(x)u , (21) 

with y in M, a: in Note that to oppose to what has been done in the 
previous subsection, now the state component y is a scalar and a; is a vector. 
Note moreover that the functions h, f and g do not depend of y. This 
restriction on h has been partially removed in our recent work in [S]. 

The hrst order approximation of the system is denoted by 


'OH' 


■ 0 ■ 

0 F 

, IB = 

G 


withi7=f(0), F = ff( 0 ), G = (?( 0 ). 

For this class of system we make the following assumption. 

Assumption 3. For all couples {K^, Px) with Kx in and Px a positive 

definite matrix in such that Px{F + GKx) + {F + GKx)'Px < 0 , there 

exists a smooth function 14 : 1^”“" —t M+ such that iJ(14)(0) = 2 Px and such 
that for all X ^ 0 

LgVx{x) = 0 ^ LfVx{x) < 0 . (23) 

This assumption establishes that the stabilization with prescribed local 
behavior is satished for the x subsystem. With this Assumption we have the 
following theorem whose proof can be found in [ 1 ]. 
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Theorem 5 (Forwarding Case). Let Assumption be satisfied. Let in 
he a vector such that the matrix A + BJFq is Hurwitz with A and ® 
defined in (d^. Then there exists a smooth function Oo : M”' —)■ which 
solves the global asymptotic stabilization with prescribed local behavior. 

Similarly to the backstepping case this theorem with Theorem [2] establish 
that given Q, a positive definite matrix in R"^”, and R, a positive real 
number, there exists g, r and Oo which is solution to an optimal control 
problem with cost J{x,u) defined in ([6]), with q and r which satisfy ffT2|) . 
Consequently, similarly to the backstepping case, we can design a globally 
and asymptotically stabilizing optimal control law with prescribed local cost 
function. 

5 Illustration on the orbital transfer problem 

As an illustration of the results described in the previous sections, we consider 
the problem of designing a control law which ensures the orbital transfer of a 
satellite from one orbit to another. In this section we consider the approach 
developed in [9] where a bounded stabilizing control law was developed. More 
precisely, we study the class of optimal control law (in the LQ sense) that 
can be synthesized. This may be of interest since, as mentioned in p], it is 
difficult to consider performance issues with this control law. 

Consider the example presented in [9]. Applying a suitable coordinate 
change it yields 



Ta = -r]{l + X2fix3 

Ts = r][{l + X2f ^{1 + X2)-1 +nur 


( 24 ) 



2^{l+X2)'^h 


^■5 = h\/^(l + X2fixe + V 


Te = -?7^/TI(1 + X2fx^ + V 




where po. 










are constants values. Concerning the states, in this new coordinate system, Xi 
is the true longitude, X 2 and x^, are the x and y components of the eccentricity 
vector, ^^4 is the parameter, x^ and Xq are the x and y components of the 
momentum vector. 

In compact form, the previous system is simply: x = a{x) + br{x)ur + 
b 0 {x)ug + bh{x)uh ■ The first order approximation of this system around the 


equilibrium is given as A = 77 


Note that these matrices can be rewritten as A = diag{A, Ai} 

where Aq = rj 


■ 0 

2 

0 

1 

2 

0 

0 ■ 


■ 0 

0 

0 ■ 

0 

0 

1 

0 

0 

0 


0 

0 

0 

0 

1 

0 

J_ 

PO 

0 

0 

and B = 1 / 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

2 po 

0 

0 

0 

0 

0 

0 

1 


0 

0 

1 

2 

0 

0 

0 

0 

-1 

0 


0 

0 

0 _ 


Aq 

O13 


A 2 

0 


and B = diag{B, B 2 } , B = 


Bo 

0 


O31 

2 

V 


A 

2 

0 

1 


■ 0 1 ■ 
-1 0 

, and, A 2 = p 

- 1 - 
2 

0 

_j_ 

,Bo = ly 

1 

0 0 

_1 

, B 2 = ly 

- 1 ■ 
2 

0 



- PO - 


i 




The control strategy developed in [9] was to successively apply backstep- 
ping, forwarding and dissipativity properties. 

With the tools developed in the previous sections, we are able to solve 
the locally optimal control problem for a specihc class of quadratic costs as 
described by the following theorem. 


Theorem 6 (Locally optimal stabilizing control law). Given Qo a positive 
definite matrix in and Rq in M+. Let Pq be the solution of the (partial) 
algebraic Riccati equation: 


AqPo + PqAo — PoBoRq ^B'qPo — —Q 


(25) 


Then for all positive real numbers Rq, Ri, R 2 , pi, P 2 such that the matrix Q = 


diag{Q, pIB2R2^B2} , Q = 


Qo 

A'Po 


PoAo 


0^2 


is positive, there exists q 


andr and a globally asymptotically stabilizing control law {ur,ue,Uh) = ao(x) 
which is solution to an optimal control problem with cost J(x-,u) defined in 
with q and r which satisfy / f7^) . 
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Proof : First of all, when ug = Uh = ^ and when X 4 = po, then the dynamics 
of the (xi,X 2 ,X 3 ) subsystem satishes 

f Xi = r][{l + X 2 f - 1 ] 

} X2 = -T]{1 + X2fx3 (26) 

[ F3 = 77(1 + X2yX2 + PUr. 

It can be noticed setting y := x^ and x := X 2 the (a^ 2, subsystem is 
in the strict feedback form fllSp . Note that employing Theorem 01 it yields 
that for this system all locally stabilizing linear behaviors can be achieved. 

Moreover, setting y := Xi and x := {x 2 ,X 3 ) the (a’l, ^^2, ^^3) subsystem is 
in the feedforward form fl2T]) . Note that employing Theorem [5l it yields that 
for this system all locally stabilizing linear behaviors can be achieved. 

Hence, with Theorem [T], it yields that given Pq which by fl2S]) is a CLF 
for the hrst order approximation of the system (1261) there exists a smooth 
function Vq : 1®^ —^ 1^+ such that 

• Vo is a CLF for the {xi, a^ 2, -^3) subsystem when considering the control 
Ur and when X 4 = po, i.e. for the system (|2^ ; 

• Vo is locally quadratic and satisfies iL(Vo)(0) = 2Po • 

Let H —)■ M+ be the function defined by V{xi, ^^2, X 3 , X 4 ) = Vq{xi, ^^2, ^^3) + 
Vi{x 4 ) , with Vi{x 4 ) = pi{po — -^4)^. Note that this function is such that 
iL(l/)(0,0,0,po) = 2P , P = diag{Po,pi} . Employing fl25|) . it can be 
checked that P satisfies the (partial) algebraic Ricatti PA+A'P—PMR~^WP+ 

Q = 0 , with R = diag{Pi,P2}- We will show that this function is also a 
control Lyapunov function when considering the (a’l, ^^2, ^^3, ^^4) subsystem 
in (I2T)) with the control inputs Ur and ug. Consider the set of point in 
such that Lb^V{x) = LbgV{x) = 0. Note that LbgV{x) = 0 implies that 
X 4 = Pq. With the CLF property for the system ([26]), it yields that in this 
set LaVQ{x) < 0 for all {xi,X 2 ,xP ^ 0. Consequently, La{V){x) < 0 for 
all {xi,X 2 ,Xq,X 4 — Po) 7^ 0 such that Lb^V{x) = LbgV{x) = 0. Hence with 
Theorem [2] we get the existence of g : —)■ M+ a continuous function, at 

zero and r a continuous function which values r{x) are symmetric positive 
definite matrices such that: 

• The function q and f satisfy the following property 

P(g)(0,0,0,po) = 2Q , r(0,0,0,po) = R. (27) 
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• The function ^ is a value function associated to the cost ([S]) with q and 
r. More precisely, V satisfies the HJB equation ([H]) when considering 
the {xi, X 2 , Xs, X 4 ) subsystem in 

Finally, let V : ^ M+ be dehned by V{x) = V{xi, X 2 , x^, X 4 ) + 

) with V 2 (x 5 , Xq) = P2('^5 + ■^e)- Moreover, consider q the positive 
semi definite function q defined as q{x) = q{xi, X 2 , x^, X 4 ) + j{Lb^V{x)yR 2 ^ , 
and r defined as r{x) = diag{r(A’), i?2} • Note that the following properties 
are satished. 

• The function q and r satisfy 

//(g)(0) = 2Q , r(0) = diag{/?i,/22,/^s} ; (28) 

• The function B is a value function associated to the cost ([6]) with q 
and r. 

Hence, the control law ([7]) makes the time derivative of the Lyapunov function 
V nondecreasing and is also optimal with respect to cost dehned from q and 
r. Note however that we get a weak Lyapunov function, i.e., a proper positive 
dehnite function whose derivative in direction of the vector held describing 
fl2Tll is negative semi-dehnite. Nevertheless, following [9] , it can be shown that 
employing this Lyapunov function in combination with LaSalle invariance 
principle, global asymptotic stabilization of the origin of the system fl2T)) 
with the control law ([7]) is obtained. □ 


6 Conclusion 

In this article we have developed a theory for constructing control laws having 
a predetermined local behavior. In a hrst step, we showed that this problem 
can be rewritten as an equivalent problem in terms of control Lyapunov func¬ 
tions. In a second step we have demonstrated that when the local behavior 
comes from an (LQ) optimal approach, we can characterize a cost with spe- 
cihc local approximation that can be minimized. Finally, we have introduced 
two classes of system for which we know how to build these locally optimal 
control laws. 

All this theory has been illustrated on the problem of orbital transfer. 
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